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For chose of us collaborating on the project, the Georgetown University Consor- 
tium Project (GCP) represents both an end and a beginning. In its research design this 
three-year assessment study is an end, the product ol a series of conversations among 
education abroad professionals at Georgetown University, the University of Minnesota, 
Rice University and Dickinson College/ The study is a beginning as well, the start ctf 
a process that will allow us to shed light on what types of experiences abroad promote 
meaningful knowledge and skills, and thereby to improve study abroad program- 
ming at our institutions. 

Our lour institutions ditfer significantly in student profile, structure and ap- 
proaches to undergraduate education; in fact, we have deliberately crafted the study 
with multiple and diverse institutions in mind. What our institutions have in com- 
mon is more important: a long-standing commitment to the international education of 
students and a history ol rapid increases in study abroad enrollments. We also share a 
conviction that participation in this study will provide the measure of future success 
not merely by the crude metric of annual study abreud enrollment increases but through 
assessments that speak to the quality of our students' educational experiences abroad. 
This report written at the halt-way mark ol the study — a year and a half into it— 
presents evaluative reflections on the progress and process of the GCP to date. 



Inter-Institutional Collaboration 

Each of our institutions has demonstrated interest in research on student learn- 
ing abroad. Two different sorts of considerations led us to decide to collaborate for- 
mally in designing and carrying out this study. First, we wanted to design a study 
whose findings would be significant for future study abrtxid programming at other 
institutions. Findings about the learning of students from four dilferent types of 
institutions would be more likely to have a pcaitive impact than a study ftxusing only 
on students trom any single institution. Our review ol education abroad assessment 
research literature hid revealed that earlier research typically focused on the learning of 
students enrolled in a single institution or on students trom multiple institutions 
enrolling in the same type ol study abroad program. We continue to be struck, as we 
were when we first began to discuss how to design this study, by bow little that earlier 
research has had an impact on study abroad programming. It has been all too easy for 
one institution to discount another institution's research on the grounds that the 
study's students or programs are so different that the results are simply not relevant. A 
study fix using on students trom multiple institutions — in the GCP’s case, two me- 
dium-sized private research universities, one large public university, and one private 
liberal arts college — who would be enrolling in a wide variety of programs abrtxid 
would be far more difficult to dismiss. 

The conceptual basts of the GCP was further strengthened by our common work in 
the Forum on Education Abrtud. The Forum mission of "contributing to the growth of 
knowledge and understanding about education abrtxid and its impact in learning and 
skills development* (2001) underpins the basic goals of the GCP. The four institutions 
in the GCP are active Forum members, 1 and the original planning for the study took 
place around several of the Forum's early planning meetings. Our discussions about the 
importance of committing ourselves to assessing students' learning abroad — one of the 
Forum s five principal goals — provided a fertile intellectual backdrop that enriched our 
thinking about student learning, and determined the GCP’s focus on the twx> overarching 
questions that subsequently guided our research design efforts. 

Domain and Disciplines In Study Abroad 

The first fundamental question that influenced our research design is one im- 
plicit in any study that assesses student learning: What is it that our students are 
learning while abroad/ 

We concluded early in our discussions that our study ought to respond to this 
question more comprehensively than earlier outcomes research. Most earlier research Kid 
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focused on students from a single institution orona single type ol program abrixid. and 
many earlier studies had ftxused on only one learning domain — with much of it focus* 
ing on second-language acquisition. 4 Hie GCP would brix&den the scope of earlier 
studies by focusing on student learning in three domains: gains in second-languige oral 
proficiency, gains in intercultural sensitivity, and learning within a disciplinary context. 
In choosing to focus on three domains instead ol one, we were and rermin strongly 
influenced by our perceptions about faculty interest in study abroad. 

We recognize thit increasing numbers of (acuity at US institutions arc more deeply 
concerned about learning abrtud than had been the case in the recent past. Rapid and 
continuing increases in U.S. student enrollments abrixid have considerably increased the 
visibility and impact of study abroad on many campuses. Faculty who had once shown 
no interest in, or who had perceived scant value in, studying abroad, may haw taken 
little notice when only a small percentage ol their institution's students temporarily 
departed for classrooms overseas. However, more students now return to their home cam* 
puses sharing stones about their experiences — with miny stones focusing on the extraor- 
dinary things the students report expenencing qhJs/Jc the academic setting. With study 
abroad shifting trom a marginal activity involving relatively few students to an activity 
attracting ever increasing numbers of students, enrollments are surpassing a threshold oi 
tolerance for some faculty. The more skeptical among them are wondering aloud why 
their institutions arc encouraging still more students to go abrtud. 

Initially, the design ol the study responded to this concern by considering the 
two learning domains that have traditionally been associated with studying abroad: 
second -language acquisition and intercultural learning. It would document learning 
in both domains, and provide an undemanding about what sort ol relationship might 
exist between these two. However, it became evident that documenting learning in 
these two domains would satisfy only a part of the faculty at many institutions. 

The rapid gains in study abrixid enrollments during the past decade and more 
have both stimulated, and been stimulated by, significant increases in the number of 
non- traditional students opting to participate. Enrollments among business students 
have, for example, increased from some 1 1 % of total U.S. enrollments to nearly 20% in 
less than two decades, and enrollments among engineering and science students, though 
less dramatic, have been significant as well. Many non -traditional students have also 
proved to be more inclined to participate in programs ol shorter duration than had 
earlier generations of students. Faculty members in business and other non-traditional 
disciplines who often lead these short-term programs, as well as many of their col- 
leagues. are relatively less interested than faculty in the humanities and social sci- 
ences — the disciplinary areas traditionally associated with study abroad — in 
second-language and intercultural learning. 
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A facility member in Civil Engineering, for example, may place little value in 
student language and intercultural learning, but Still encourage students to participate in 
a three -week program that focuses on the theory and practice of bridge building through 
trips to three or lour sites in Eastern Europe. This faculty member sees value in having 
students go abruid — but the comparative, intellectual value of this sort ol program may or 
may not be associated with the second Language and intercultural goals traditionally 
identified with studying abrtxid. In order to respcxid to the educational values and interests 
ol these non- traditional faculty* members, the study design added a third dixnain: learning 
in a disciplinary context. Three of the four broad disciplinary areas included — business, 
engineering and the sciences — are not traditionally disciplines with large enrollments in 
study abroad. We chose to include a fourth — the humanities — as well since we anticipated 
that a high percentage c£ students who would be participating in the study wixild be 
majoring within this braid area. Our commitment to assisting outcomes in these four areas 
would, as we will see, both enhance and complicate our study. 

Learning Environments and Study Abroad 

The second fundamental question that guided the design of our study, one that 
has received little attention in earlier research, is: What types erf learning environments 
abroad tend to support or promote student learning? 

The great majority ol earlier assessment research has treated "study abroad" ge- 
netically, implying that differences between one type of program and another were 
irrelevant. However, it seemed intuitively obvious that different sorts of experiences 
abroad will impact student learning in different ways, and we incorporated the testing 
ol this intuitive conclusion into the design of the study. In committing to a design 
that would distinguish between qualitatively different types of educational experi- 
ences a braid, the GCP adopted, with minor changes, the program classification system 
that Lilli Engle and John Engle have developed (Engle and Engle, 2003). This system 
would provide a better basis for outcomes measurement than the traditional classifica- 
tion of study abroad programs. 1 

The traditional classification system on which study abroad professionals have 
long relied provides descriptive labels for program types: "island," "direct enroll- 
ment," "faculty led," "exchange," "short term,** "experiential" and other program "types. “ 
In practice these types frequently overlap. A "faculty led" program may directly enroll 
students in a part or all of their courses at a host university, may provide for reciprocal 
exchange of students between home and host institutions, may incorporate intern- 
ships, service -learning or some ocher type of experiential work, and so on. This conven- 
tional approach fails to take into account certain salient program characteristics which 
arguably influence or even shape student learning, like the type of student housing or 
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the availability of experiential activities. A direct enrollment program that houses 
students in apartments with other students from the sending institution presumably 
provides different learning opportunities than a direct enrollment program that houses 
students with host families, or requires them to participate in community-based vol- 
unteer projects or internships with local firms or organizations. 

In Engle and Engles classification system, individual programs arc defined 
with retexence to the way that the program responds to seven pee* identified program 
characteristics. The variables of a program's design establish the parameters within 
which students learn in that program. This approach to classification allows outcomes 
to be measured through providing a common basis of comparison across programs. The 
seven key elements are: 

1 . Duration of program 

2. Amount of earlier target language study for each student 

3. Extent to which target language is used in course work on site 

A. Context of academic work (students are enrolled in courses in one of four 
ways: home-institution courses taught by accompanying home* institution 
faculty, spec tally -arranged host-university courses taught by host-institu- 
tion faculty, regular university courses taught by host-institution faculty, 
or a combination ol the above) 

5. Type of housing for each student 

6. Whether students participate in structured cultural'expcriential learning 

7. Whether students receive on-site mentoring that asks them to reflect on 
learning 

Our research design provides foe these seven key elements to operate as indepen- 
dent variables. W'e have collected enough data to be able to begin to measure the 
impact of each of these variables, as well as the impact of different groupings of the 
variables (for example, the combined impact of housing, duration and use ol the target 
language in course work), on the study’s three learning domains — second- language 
acquisition, gains in intercultural sensitivity, and learning in a disciplinary* context. 
In order to assure a significant range ol variability across program types, we are testing 
student learning at some fifty different sites abroad, having selected the individual 
programs according to the varying ways that each responds to the seven key elements. 

Specific Research Questions 

The GCP research activities have been guided by a number of specific research 
questions that we developed for each of the three learning domains we had selected os 
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focal points the study. These research questions focus on student learning within, as 
well as across, the three learning domains: 

In the Second- La nyuace Domain: 

1 . Are there significant differences in second-language oral proficiency gains 
between students who went abroad and those who learn on the home cam- 

pus? 

2. What demographic and program design features (the seven key elements 
identified by Engle and Engle in addition to student major, year in school, 
gender and a few other demographic variables) significantly improve sec- 
ond-language oral proficiency gains.' 

3. Are there significant differences in second-language oral proficiency gains 
between students who participate in more traditional compared to less tra- 
ditional study abroad sites? 

In the Inicrcnllnrjl Proficiency Donum: 

1 . Are there significant differences in intercultural-proficiency gains between 
those students who study abroad and those who remain on the home cam- 
pus' 

2. What demographic and program design features significantly improve 
intercultural proficiency? 

3. Are there significant differences in gains in intercultural-proficiency of 
students enrolled in different types of study abroad experiences? 

4. IXi gains in intercultural proficiency correlate with gains in second-lan- 
guage oral proficiency? 

3. Are there significantly different levels ol intercultural proficiency ot stu- 
dents at the completion of their course of study abrtxid and over time (five 
to six months later)? 

6. Are there significant differences in intercultural proficiency gains among 
students who study the same language in study abrtxid programs in devel- 
oped and non -developed countries? 

7. Are there significant differences in intercultural-proficiency gains among 
students who study in countries where English is the language ol commu- 
nication and students who study in countries where a second language is 
the dominant language of communication? 
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la the Domain 6} Diuif^nrary Liam nr %: 

1 . What do Business. Engineering. Science and Humanities faculty want and 
expect students in their particular disciplines to learn abroad? 

2. What demographic and program design factors significantly improve learn- 
ing in particular disciplinary contexts? 

3. What is the relationship of second-language proficiency and/or intertul- 
tural proficiency to learning in particular disciplinary* contexts? 

Critical Project Support 

We realized early in our discussions that while we held strong views about the 
goals of the study, and each had years ol experience managing education abroad pro- 
grams, we did not collectively have the resources that needed to begin, much less to 
complete, this level of comprehensive study. We thus sought three different types of 
assistance, each of which has proved significant in the research design, instrument 
development and testing to date. First, we did not have access to financial resources at 
our own institutions that would allow us to proceed with a study of the scope we 
envisioned. The funding we have received through the Department of Educations 
Title VI International Research and Studies Program has allowed the extensive research 
activities we have accomplished to date. 

Second, we recognized that we would need to seek expertise if we were to carry 
out a valid and reliable assessment study. The Title VI funding allowed us to contract 
os consultants three educators and researchers, each ol whom continues to provide 
important expertise and direction in research design, instrument selection and devel- 
opment, training, workshop facilitation and data analysis. Dr. Mitchell Hammer (Pro- 
fessor ol International Peace and Conflict Resolution at American University and 
co-creator of the Interculturol Development Inventory) and Dr. Michael Paige (Profes- 
sor of International and Intercultural Education at the University of Minnesota) pro- 
vide expertise in intercultural learning and research design. Dr. Margaret Malone 
(Senior Testing Associate for the Language Testing Division of the Center for Applied 
Linguistics and former Director ol Peace Corps* worldwide testing program), brings to 
the study her expertise in second language acquisition and assessment design. 

Hurd, we realized as we were selecting the programs abroad that would serve as our 
testing sites that we were not going to end up with a sufficiently broad range ol programs 
il we confined ourselves to those operated by our four institutions. We therefore ap- 
proached several study abroad providers and asked whether they would be interested in 
participating in the study. They generously agreed; our testing sites thus include a 
number of programs operated by The Council on International Educational Exchange 
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(C1EEX The Institute for the International Education of Students (1ES), the University of 
Pittsburgh and the American University Center ot Provence. The collaboration of these 
program providers, in providing access to students at a number ot their sites abroad, allows 
the GCP to collect data across a wider range c/ program types than would have been possible 
had the research been restricted only to programs run by the lour institutions. 


Oral Proficiency and 
Intercultural Sensitivity 

Oral Proficiency 

The Simulated Oral Proficiency Interview (SOPI). an instrument developed in 
the mid* 1980s at the Center for Applied Linguistics as an alternative to the Oral 
Proficiency Interview (OPI), is used to measure the relative proficiency gams of both 
the students abrcud and the student control groups on the home campuses. The OPI 
requires a certified tester to conduct a face- to*!ace interview with, and to rate the oral 
proficiency ot, each subject. The SOPI. a cape-mediated instrument whose validity and 
reliability are well established (Stansfield 1991, 1996), is better suited to the needs of 
our study since it requires no trained human interviewers on site: instead, it uses a test 
booklet, a master test tape, and an examinee test cape. SOPI administration at the sites 
abroad requires no special training or expertise. The local Resident Director or another 
administrator at each program site does the testing: he or she simply pushes the ’play* 
button on one tape recorder, the "record*' button on another, and then allows the 
student to complete tasks that are assigned both on the master tape and in the test 
booklet. Students complete the SOPI in about forty-five minuta. At most sites, the test 
is administered either in small groups of up to three students, with two tape recorders 
used for each student, or in larger groups in language laboratories. Once the testing is 
completed at test sites abroad, raters at Georgetown University’s Office of International 
Programs, trained to evaluate SOPI performances using ACTFL proficiency guidelines 
0999), assess the relative proficiency of each student. 

Student oral proficiency gams across eight languages are being measured: in 
Arabic. French, German. Hausa, Japanese, Mandarin. Russian and Spanish. Knowl- 
edge gained through the SOPI testing will serve to establish standards for oral -profi- 
ciency gams across eight languages in a wide variety* of study abroad programs. While 
a significant number of studies have examined second -language gains in a study 
abroad context, our research aims to go beyond these earlier studies, none of which has 
documented gains in a number ol languages while simultaneously examining the 
impact of the various program design and demographic variables. 
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Intercultural Sensitivity 

The GCP is utilizing the Intercultural Development Inventory (1DI) to measure 
student gains in intercultural sensitivity. Theoretically grounded in Milton Bennett s 
‘Developmental Model ol Intercultural Sensitivity/ a frequently -cited model that 
describes several developmental stages that human beings go through in adapting 
interculturally (Bennett, 1993; Hammer, Bennett 6c Wiseman, 2003). the ID1 is a 
well -respected, cross-culturally generalizable paper -and -pencil instrument that allows 
individual subjects to be petitioned along a developmental continuum that identifies 
the level of intercultural competence of each respondent. Extensive field-testing and 
analysis of the 1DI have shown it to be reliable and valid. The 1D1 has been developed 
using rigorous psychometric scale development methods (DeVellis, 1991h the exten- 
sive testing used in developing the 1D1 (Hammer, Bennett Ac Wiseman, 2003; Hammer 
and Bennett, 1 998/2004) supports its use in measuring student gains in intercultural 
proficiency during study abroad. It typically takes respondents no more than twenty- 
five minutes to complete the test. 

Participating students take the ID1 three times: first as a pre-test, shortly alter 
the students arrive at their program sites abroad; second as a post-test, shortly before 
the end of their programs; and finally on a post/ post -test basis, some five to six 
months after they return to their home campuses. We hypothesize that administering 
the 1D1 a third time, as a post/post -test six months alter the students' return, will shed 
light on an important question: how much of the intercultural learning that takes 
place through participation in various sorts of education abroad experiences occurs 
during the months following the return to campus, when students have had time to 
reflect upon and otherwise process their experiences abroad/ Our use of the 1D1 to 
document the intercultural learning ol students, including the third administration 
ol the 1D1 to measure learning after re-entry, breaks new ground. Very lew studies 
have in fact even attempted to measure gains in intercultural proficiency of students 
abroad, as measured through a valid and reliable instrument like the 1DI (see Paige. 
2003). No previous study has attempted to correlate gams in intercultural profi- 
ciency with the key program and demographic variables whose impact we will be 
measuring. Finally, each institution laces challenges in attempting to integrate re- 
turning students back into the home campus; we anticipate that the IDI data will 
provide significant inlormation about student learning occurring during this criti- 
cal re-entry period. 
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a New Instrument: 


The Third Domain 

Interview Guide 

Our research design was significantly informed by faculty perceptions and con- 
cerns about student learning abroad. The decision to include a third domain, learning 
within a disciplinary* context, was motivated by our sense that the focus of our research 
should proceed beyond second -language and intercultural learning if the study were 
to respond effectively to the interests of faculty in business, engineenng and science, 
disciplines historically less associated with study abroad than the humanities and 
social sciences. Faculty members designing and leading programs abroad whose objec- 
tive is to provide professional or technical learning opportunities for their students 
would be better convinced by research that argues for the value ot study abroad from 
within their disciplines. In order to incorporate into the research design learning 
outcomes valued by faculty in business, engineering and science, as well as faculty 
members in the humanities, we organized four day-and-a-half faculty* workshops dur- 
ing the first year of the study. 

We convened separate workshops for business faculty and humanities faculty* at 
Georgetown University in December 2002, a third workshop for engineering faculty 
at Rice University in February 2003 and a fourth for science faculty at the University 
ol Minnesota in April of that same year. Ten faculty* members wxrre invited to attend 
each of the workshops: four from the hosting institution and two trom each ol the other 
three consortial institutions. (The engineering workshop at Rice was an exception: 
since among the consortial institutions only Rice and Minnesota offer engineering 
degrees, a total of only six engineering faculty* members attended, four from Rice and 
two trom Minnesota). Two education abroad administrators from each institution, the 
three outside consultants and, in the cose ol the workshop for science faculty* at Minne- 
sota, the study's external evaluator 4 , also participated. 

In addition to providing overviews of the SOPi and JD1 for pirticipating fac- 
ulty. the study’s three consultants facilitated discussions that allowed the faculty to 
identify learning competencies — the specific knowledge, skills, aw*areness or values — 
that they believed that students in their disciplines acquired, developed or enhanced 
while studying abroad. Faculty members from each of the disciplinary groups were 
told that their goal was, by the end of the workshop, to identify and produce a list of 
spec ific competencies, and each group did produce such lists. When the last ol the four 
workshops was over, the study’s three outside consultants analyzed the competencies 
that each ol the four groups ol laculty had identified, and they highlighted lour *core 
competencies" that had been discussed at all lour workshops. Faculty concluded, alter 
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considerable discussion, that students majoring in business, engineering, the humani- 
ties and the sciences acquire, develop or enhance the following shared competencies 
while studying abroad: 

• The ability to function on multicultural teams 

• An understanding of ethical and professional responsibility 

• An understanding of the impact ol disciplinary solutions in a global and 
societal context 

• An ability to apply disciplinary knowledge 

The consultants subsequently developed an interview guide that was field tested 
at the end of spring semester 2004. This guide consists ol three different hypothetical 
scenarios, each of which asks students to imagine how they will respond to a series oi 
questions posed by an interviewer during either a job interview or an admissions 
interview for graduate school. After being trained at Georgetown by the consultants to 
conduct the interview, staff at the consortial institutions conducted these field tests by 
interviewing seniors who studied abroad dunng spring semester or summer ol 2003. 
In responding to the questions posed dunng these hypothetical hiring or admissions 
scenarios, these seniors will, we hypothesize, respond in such a way as to demonstrate 
that they have acquired, enhanced or developed the four core competencies through 
their experiences abroad. Control groups ol seniors who have not studied abroad will 
also be interviewed at the consortial institutions. All interviews will be taped; the 
consultants will train staff at Georgetown University to analyze the interviews. 

Research Limitations and Implications 

We are still some months away from being able to analyze and interpret test data. 
The study’s formal testing began in Fall 2003* and Fall semester participants are not 
scheduled to take the post/post-cesc 1DI until April of 2004; the field test of the third 
instrument, the field guide, occurred in May, 2004. However, even in the absence of 
hard data, our expenence in designing the study, in carrying out the pilot and in 
undertaking formal testing for a semester and a half has led to several early conclusions 
that have implications for future research. 

I. It is much more difficult to get students to volunteer for this sort of study 
than we had anticipated. The original grant proposal called for testing as many as 800 
students abnxid a year; we were able to test only 200 students during spring semester 
and summer of 2003, the pilot phase of the study. In fall 2003, the first semester of the 
formal study, some 200 students completed required pee- and post-tests (this represents 
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a c ademic yen students who completed the pce-test SOPls and lDls. as well as hill semester 
students); at this rate, we anticipate that in 2005-04 we will test between MX) and 330 
students during the lour testing periods (academic year, fall semester, spring semester and 
summer). The attrition rate has to date been significant: only about 33% of the students 
who volunteer to take pre-tests are to this point completing post-tests. We anticipate 
additional attrition — how much remains to be seen — when students who were abroad in 
Fall 2003 are asked to take the ID1 posipost-tests at their home campuses. 

We made special efforts to motivate student participants, such as a lottery that 
would award prizes to a limited number of students, with first prize the reimburse- 
ment ol the winning students international round-trip ticket. However, during the 
pilot phase of testing it became clear that the lottery was doing little to encourage 
students to participate. We therefore adopted new tactics to increase part ici pat ion. 
First, the focus of our motivational efforts moved from the students to the Resident 
Directors and other staff at the sites abroad who are responsible for administering the 
SO PI and 1D1. Program staff at Georgetown made special efforts to communicate di- 
rectly with these staff abroad, both to find out what particular challenges, if any. each 
faced in testing students, and to ask them to take special pains to encourage more 
students to participate. The administrators abroad were especially encouraged to speak 
to the advantages of the study, to emphasize that participating students will receive a 
certificate with their SOPI post-test score. Second, the 1D1 has been posted on-line so 
that students can complete the test at a time convenient to them. 

Our experience to date suggests that there is an inverse proportion between 
design complexity and student participation: the more complex and time-consuming 
the testing, the more difficult it will be to get students to take the tests. In a similar 
win, we also believe that the number of institutions involved in a study probably 
influences student participation: it will be relatively easier for an institution to moti- 
vate its own students to partic ipate in a study thin it will for an institution to get other 
institutions' students to participite. In other words, those involved in designing a 
complex study with programs abroad sponsored by multiple colleges and universities, 
one that additionally relies on provider programs abroad, need to be prepared to devote 
significant energies to motivating student participants. 

2 . In aiming to document the impact of seven key learning variables on student 
learning within and across three domains, our study’s scope, relative to most earlier 
studies, is quite broad. Even so. it fexuses largely on the characteristics of programs abroad 
than it does on participants. Only the second of the seven key variables — the amount of 
earlier target language study — focuses on the student. As we’ve noted, we’re committed 
to this assessment study since we believe that the results of txir research will provide 
information that will allow us to make changes in programs abroad in order to maximize 
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student learning. For example, it we learn that students who participate in structured 
experiential learning activities make greater oral -proficiency gains than those enrolling 
in programs with no experiential component, we will presumably want more of our 
students to do internships, community • based work, research and other forms of experien- 
tial education while abroad. However, we recognize that we would be wise to wait for the 
results ol other studies that locus on learner characteristics before deciding that all of our 
students should enroll in programs with experiential components. 

We believe that future research focusing on such learner characteristics as student 
motivation and student learning capacity will complement the research we're doing 
and will provide a more complete picture of learning abroad. It seems likely that there 
are students who are motivated to learn a second Language in certain contexts, and for 
certain purposes, rather than others. A student who is socially reserved and motivated 
to learn well in an academic setting, for purposes ol improving his or her writing 
skills, may. in other words, not automatically perform as well when placed in a com- 
munity-based learning situation that requires him or her to interact with native speak- 
ers in natural conversations. We have also known students who seem to have an unusual 
capacity for learning second Languages, naturally gilted language learners who rap- 
idly and effortlessly acquire second languages, whether in a classroom on the home 
campus or in any of a variety of programs abroad. There is a clear need for research that 
will provide better insights about learner motivation and capacity — and we will do 
well, in the absence of such research, not to draw too many conclusions based on 
program -focused research of the sort that we are conducting. 

3- We chose to use the SOPI to measure oral proficiency because it is a valid 
and reliable instrument that allowed testing of oral proficiency gains in eight lan- 
guages at a large number of sites because the testing can be completed without 
having to send certified OPI interviewers abroad. The test will allow us to examine 
whether gains in second language oral proficiency correlate with gains in intercul- 
turai sensitivity. However, since the SOPI is limited to measuring gains in oral 
proficiency, this study will not reveal whether our students are making gains in 
writing or reading while abroad. 

It will be important for future studies to provide more holistic measures cf 
second -language learning abroad. W'e arc interested in learning more about the effec- 
tiveness of the Test d'Eta! nation dt Franfaii. The T£F, designed by the Cbambn Je 
Comment el ef Industrie Je Paris and used widely in France and Canada, measures oral 
comprehension, wntten comprehension and vocabulary and structure. Future research 
should seek to document the impact ol the seven key variables on student Language 
performance based on the TEF or ocher instruments that allow for more holistic mea- 
surement ol Language performance. 



4. When we originally designed the study, we intended to include a longitudinal 
component that would collect data on the impact that study abroad has on post -study 
abroad performance in courses in the major. on cumulative GFAs, on time to graduation, 
employability after graduation, and on other data that faculty in business, engineering, the 
humanities and science regard as indicative o I their students' success. This would hast 
involved staying in toiaih with large numbers of participants for some number of years 


beyond graduatitxi. We decided me to pursue this part c £ the study because the administra- 
tion of other components w® proving more time-consuming than anticipated. 

Hopefully, the results of testing with the interview guide that the GCP consult- 


ants have developed will provide evidence that study abreud allows students, espe- 
cially those in non -traditional disciplines, to enhance their professional prospects. 
However, more research needs to be done to convince skeptical faculty that their majors 


will be better prepared for having studied abroad. There is value in designing a 
longitudinal study of the type that we originally envisioned, as there is in undertak- 
ing retrospective analyses of data already collected from past participants.' 


What's Next 

This is an ambitious study that has in several respects proved more challenging 
than we had anticipated. We have, however, already learned a significant amount about 
research design and are confident thit the study's data will offer important insights about 
the extent to which each of the study’s seven key independent variables enhances student 
learning. We look forward to sharing the results of our study in a future FmH&i issue. 


Notes 

* The authors would Uke to (honk the members cf cheir staffs who are responsible for the day- 
to-day administration of the research program Mata Stierankova. Georgetown University. 
Project Coordinator, Sophie Gladding. University cf Minnesota; Dr. Cheryl Matherly. Rice 
University; and Annmane Whalen, Dickinson College. 

J The study is funded by two US. Department cf Education Ttfle VI International Research and 
Studies Program grants. A three-year grant was awarded in 2002 to Georgetown University for 
the study designed at that pome including Georgetown University, the University cf Minnesota 
and Rice University. That original consonium subsequently invited Dckiascn College to pom 
the study. Dwrkinscn in 2005 was awarded a separate two-year Department of Education Title VI 
grant to fund its participation in the study. 

* Vande Berg. Balk cum and Scheid are founding Board members of the Forum, and Whalen is a 
member of the Forum's Advisory Council. 

4 The Fall 1998 special issue of Fn+rurt, ~ Language Learning in a Study Abroad Context.* 
(Guest Editor. Barbara P. Freed), and Freed s earlier £*W L**#*# Acqthmm tn a ShtJy Ah%*J 
CWexr. provide comprehensive collections of and commentaries on research cn second language 
learning abroad. 


Id 



Frontiers: T1 * IncndiKtphfury Journal of Study Alxuii 


1 The commentary here draws co the discussion abcait the Engle and Engle's classification 
system m Vande Berg. M. (200 » A Research -based Approach to education abroad classification. 
www.fotumru.arg<rwearch.html. 

* Carl Herrin (incoming chair of the Section cn U.S. Students Abroad (SECUSSAJ of NAPSA: 
Association cf International Educators, and a founding Board member of the forum on 
Education Abroad) is the study's external evaluator. 

’ See. m this regard, the article in this special Proutua issue by Dr. Mary Dwyer. "More is Better, 
the Impact of Study Abroad Program Duration,* which focuses on data collected through a 
retrospective longitudinal study earned out by the Institute far the International Education of 
Students (1ES). 
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